DOCOHBNT BESDHE 



ED 117 089 



95 



SP 009 789 



AOTHOE 
TITLE 

INSTITUTION 

SPONS AGENCY 

POB DATE 
CONTRACT 
NOTE 

ED)rS PRICE 
DESCRIPTORS 



Clarkr Christopher M, ; And Others 

Three Experiments on I<earning to Teach, Research and 
Development Memorandum No, lUO, 

Stafford Univ., Calif. Stanford Center for Research 
an^ De^drelopment in Teaching, 

National Inst, of Education (DHEW) ^ Hashington, 

T).6. 

Dec 75 

NE-C-00-3-0061 
32p. 

■mp-$0.76 HC-$1.95 Plus Postage 

Academic Achievement; Affective Behavior; Effective 
Teaching; *Learning; *Students; *Teachers; ^Teaching 
Experience; Teaching Procedures; ^Teaching Skills; 
Teaching Styles 



ABSTRACT 

j This paper reports on three studies^ of the changes in 

teacher effects on student learning and attitudes as a function of 
teacher practice. Two studies were performed in a tutorial context ^ 
the first with ^ tutors and 16 students^ the second with 17 tutors 
and 68 students. The third study used small group instruction with 12 
teachers and 288 students. In each study, the same teachers taught a 
short curriculum unit three or four times, teaching different 
students in each trial. The results of the studies showed marked^ 
indp-vidual differences among teachers in the extent to which their 
students learned more or less. Feu teachers showed marked increases 
Tir student learning with practice. It was also shown that, on the 
average, sti:dent achievement decreased with teacher practice. Student 
attitudes towc^^d the learning situation and toward thems'^lves as 
learners changed in a curvilinear fashion. (Several grapiis are 
included to illustrate the data.) (Author/RC) 
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The Center's mission is to improve teaching in American schools. 
Its work is carried out through three research and development programs 
Teaching Effectiveness, The Environment for Teaching, and Teaching and 
Linguistic Pluralism — and a technical assistance program, the Stanford 
Urban/Rural Leadership Training Institute. A program of Exploratory 
and Related Studies includes smaller studies not included in the major 
programs. The ERIC Clearinghouse on Information Resources is also a 
part of the Center. 

This paper is part of the work of the Program on Teaching 
Effectiveness . 
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THREE EXPERIMENTS ON LEARNING TO TEACH 



Christopher M. Clark Richard E. Snow Richard J. Shavelson 
Stanford University Stanford University UCLA 

To what extent is training really necessary for teachers? Beginning 
teachers frequently criticize their professional preparation on the 
grounds that it is largely irrelevant to their needs in the classroom. 
Veteran teachers often feel that experience was their best teacher — that 
the best preparation for teaching is teaching itself. Teachers at the 
junior high school, secondary, and college levels who teach several sec- 
tions of the same course often report that their second or third time 
through a lesson seems more effective than the first. In this connection 
Medley argues that 

the effective teacher will differ from the ineffective teacher 
primarily in his control over the repertory of competencies he 
commands; in his ability to adapt his behavior to the pupils, 
the purpose, and the situation in which he operates; and most 
important of all in his ability to learn from his own experience . 
(Medley, 1970) 

The process of learning from experience has also been investigated 
in the psychological laboratory. In 1949, Harlow published a paper en- 
titled "The Formation of Learning Sets," in which he showed that monkeys 
and children improve with practice across a series of similar learning 
problems. That is, they learned how to learn a particular class of tasks 
Learning- to- learn became an important concept in learning research (see, 

■^Based on "Experiments on Learning to Teach," presented at the 
Annual Meeting of the American Psychological Association, Chicago, 
September 1975. 
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for example, Harlow, 1959; Reese, 1964). The present research sought to 
determine whether teachers learned to teach, using a paradigm similar to 
that of the Harlow studies. The basic question was: Do teacher effects 
on student learning improve as teachers gain experience in a particular 
teaching situation? That is, do teachers teach more effectively (as 
measured by amount and kinds of student learning) the second or third 
time they teach a given curriculum unit than they do the first time? 
Three studies of this question were undertaken. >The first examined this 
question alone in a tutorial context. The second added a training varia- 
ble, again in a turorial context. The third was conducted in a small 
group instruction situation. The studies were performed as part of the 
Program on Teaching Effectiveness, Stanford Center for Research and 
Development in Teaching. 

The general hypothesis for the three experiments is represented in 
Figure 1. In each study, the same teachers taught a short curriculum 
unit three or four times (trials I-IV) . Different students were taught 
in each trial. The predicted effect of teacher practice was that stu- 
dents taught on the later trials would learn more and express more 
favorable attitudes about the situation slv^ themselves than students 
taught in the earlier trials. 
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Fig. 1. Predicted pattern of change in student learning as 
a function of teacher practice over four trials. 
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The First Study: Tutoring 

In the first study, four advanced graduate students in education 
tutored junior high school students, one at a time, in physics. Each 
tutor taught one stud^.nt for five one-hour sessions, and then was 
assigned randomly to a new student the following week to repeat the 
material. Each tutor taught four students successively. Thus, 16 
students participated. Figure 2 shows the design of the first study. 

Each student took an achievement test before and after instruction. 
Table 1 summarizes the results; Figure 3 shows the changes in mean student 
achievement by week. These results indicate that, on the average, the 
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Week 



Tutbr 


I 


II 


III 


IV 


1 


S-1 


S-5 


S-9 


S-13 


2 


S-2 


S-6 


S-10 


S-14 


3 


S-3 


S-7 


S-11 


S-15 


4 


S-4 


""s-8 


S-12 


■S-16 



Fig. 2. Design of the first study. Four tutors taught 
oae student per week over four weeks. 



TABLE 1 



Students' Pretest and Posttest Achievement Scores 
(possible range, 0-36) 









Achievement 


Achievement 




Week 


'Tutor 


Student 


Pretest Score 


Posttest Score 


Difference 


I 


A 


1 


12 


10 


-2 




B 


2 


7 


13 


6 




C 


3 


16 


15 


-1 




D 


4 


7 


11 


4 


II 


A 


5 


14 


22 


8 




B 


6 


9 


14 


5 




C 


7 


9 


8 


-1 




D 


8 


12 


22 


10 


III 


A 


9 


6 


15 


9 




B 


10 


14 


18 


4 




C 


11 


15 


22 


7 




D 


12 


14 


19 


5 


IV 


A 


13 


12 


18 


6 




B 


14 


13 


13 


0 




C 


15 


25 


27 


2 




D 


16 


17 


19 


2 <. 
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teachers obtained higher achievement from their students in each suc(ies- 
sive week. But the effect was weak and was marred by one student's 
unusually high pretest score in Week IV. The results were considered 
encouraging enough to attempt a larger experiment. 

The Second Study: Tutoring 

The second study was similar in design to the first. Here, however, 
17 participating tutors were volunteer undergraduates, nine of whom re- 
ceived 12 hours of training in tutoring skills before teaching. The tutor 
training consisted of exercises on questioning, listening, and explaining 
in a tutorial conj;^ext (see Clark, 1972). 

9 . 
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Week 

Tutor Training 

Tutors Workshpp I II III IV 



Experimental 

Group (N = 9) X S1-S9 S18-S26 S35-S43 S52-S60 

Control 

Group (N = 8) 0 S10-S17 S27-S34 S44-S51 S61-S68 

Fig. 4. Design of the second study. Seventeen tutors (nine 
trained and eight untrained) taught one student per 
week over four weeks. Total N = 68 students (S). 

Again', junior high school students (N = 68) were randomly assigned 
one at a time to a tutor for one week's physics instruction; this con- 
tinued for four weeks (see Figur|? 4).' Because laboratory space was not 
available, tutors had to meet their students outside of school. An 
'Attempt was made to reicord all tutoring sessions on audiotape for analy- 
sis of teaching proce$s variables. Achievement and attitude measures 
were administered pre and post. \ 

Table 2 shows the mean pre and post achievement scores for students 
of tutors with and without training. Figure 5 shows the same results 
graphically. 

Table 3 shows tfte students' mean pre and post scores on their ratings 
of themselves as learners (General Scale) , themselves as students of 
physics (Physics Scale) , and themselves as students in a tutoring situa- 
tion (Tutoring Scale) . Figure 6 shows these changefe in student self- 
rating scores graphically. 
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TABLE 2 



Means 


and Standard 


Deviations 


of Physics Achievement 


Scores 


Week 




Group 




Pretest 


Posttest 


T 
1 


E 


(N=9) 


X 
SD 


7 Q Q 

2.98 


1/ . JO 

3.71 




C 


(N: 


-8) 


X 
SD 


lU , JO 

2.20 


1 J • 1 J 

1.55 




Both 


(N= 


=17) X 
SD 


2.86 


IZ • oz 

2.83 


T T 


E 






X 
SD 


1,27 . 


I 1 A7 

II • 0 / 

.2,00 




C 






X 
SD 


O • JO 

2,13 


19 ^'^ 
IZ • D J 

4.31 




Both 






X 
SD 


7 71 ' 
/ • / 1 

1.79 


19 19 

J.Z • J.Z 

3.22 


T T T 
ill 


E 






X 
SD 


2.87 


1 J • 4^ 

2.40 




C 






X 
SD 


y • 1 J 

2.23 


1^ • Z J 

2. 31 




Both 






X 
SD 


Q /±^ 

y • H-1 

2.53 


1 ft9 
1 J • oz 

2.32 


IV 


E 






X 
SD 


7.89 
2.32 


11.00 
2.40 




C 






X 
SD 


'roT25'^~^ 
2.43 


14.38 
2.92 




Both 






X 

SD 


9.00 
2.60 


12.59 
,3.10 
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8 



0 

MEAN ACHIEVEMENT SCORE 
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TABLE 3 





Means and Standard Deviationo of Students' 
on Self-Rating Inventory 


Sn:3res 


Week. 


Self-Rating 
Scale 


rretes t 


r OS L ues L 


I 


General 


X 
SD 


42.88 
11.44 


43.24 
14.20 




Physics 


X 
SD 


51.53 
18.20 


57.24 
21.40 




Tutoring X 
SD 


33.59 
9.43 


36.76 
11.57 


II 


General 


X 
SD 


44.88 
8.31 


46.65 
8.91 




Physics 


X 
SD 


54.12 
13.69 


58.24 
10.89 




Tutoring 


X 
SD 


35.29 
8.14 


37.24 
6.61 


III 


General 


X 
SD 


42.94 
8.94 


42^3 
10.21 




Physics 


X 
SD 


48.59 
11.71 


53.76 
13.00 




Tutoring X 
SD 


33.06 
7.42 


36.59 
8.65 


IV 


General 


X- 
SD 


44.35 
8.50 


48.47 
10.82 




Physics 


X 
SD 


49.76 
13.22 


58.41 
14.44 




Tutoring X 
SD 


35.47 
6.82 


40.82 
7.68 
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The results of the second study were discouraging. Although some 
tutors improved with practice on some student outcome measures, perfor- 
mance curves were erratic and there was no apparent average improvement. 
In fact, analyses of variance and covariance (not shown) revealed that 
on the average, control tutors (those who were not specially trained) • 

obtained higUer achievement from their students than did trained tutors, 

W 

There was some indication that this occurred because the trained tutors 

spent more time on their own skill practice and less on instruction than 

the control tutors. But this possibility cou|.d not be verified because 

/ 

the audiotapes were of poor quality. It wa^ also noted that the tutoring 
situation allowed variation in interactltoii patterns bo wide as to smother 
other effects of interest. In addition, sinc^ students had access to the 
physics text material, the effects of tutoring and the effects of studying 
were confounded. 

The Third Study; Small Group Instruction 

The third study was conducted in laboratory facilities which allowed 
small group instruction and extensive videotaping. Experienced teachers 
(six men, six women) taught the same social studies unit to three succes- 
sive groups (hereafter called classes) of eight students each (N = 288 
students). For each class, the social studies unit was taught in three 
50-minute periods in one day. Students were posttested at the end of 
each day using a multiple-choice recall test, an essay test, and an atti- 
tude inventory. Achievement pretests were not used, but aptitude data 
were collected on all teachers and stude^its before instruction, (For a 

a 

more detailed report of this study, see Clark, forthcoming,) 
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The students (116 boys and 196 girls) were paid volunteers who had 
just completed seventh, eighth, or ninth grade. They were assigned to 
classes on a stratified random basis, stratifying on verbal ability and 

V 

sex, but not grade level. The design of the third study is shown in 
Figure 7. 

Three days before teaching for the first time, each teacher was 
given two hours to read the printed curriculum material and examine a set 
of cplor transparencies which were to be used in the teaching sessions. 
In addition, each teacher was given a list of objectives to be achieved 
by the students. At the beginning of each teaching day, each teacher was 
given 90 minutes to plan the teaching session. The stu4ents were given 
one hour to read the printed curriculum material and view the color 
transparencies before entering class. 

" The student posttest data for each day of teaching are summarized in 
Table 4. To test the effects of teacher practice on student posttest 
variables, a two-factor analysis of variance (Teacher X Day) was performed 
on each variable. Scores on the Recall Test were adjusted for differences 
in vocabulary and reasoning ability by analysis of covariance. 
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TABLE 4 



Means and Standard 


Deviations 


of Student 


Posttest 


Variables 


Posttest Variables 




Day I 


Day IT 


Day III 


Recall Test^ 


X 


39.51 


40.44 


37.56 




SD 


7.35 


7.08 


9.20 


Essay Test, Concrete 


X 


12.22 


11.67 


11.15 




SD 


5.69 


4.74 


5.35 


Essay Test, Abstract 


X 


2.04 


2.09 


2.20 




SD 


1.74 


1.66 


1.88 


Attitude Toward 


X 


57.79 


59.15 


55.32 


the Situation 


SD 


, 11.06 


8.84 


10.44 


Attitude Toward Self 


X 


15.37 


15.89 


15. .21 




SD 


2.88 


2.68 


2.72 



Note: N = 288 studen**3, 96 each day. 

Recall test scores are adjusted for vocabulary and 
reasoning ability. 

For the Recall Test, on the average, adjusted class means were 
relatively stable from Day I to Day II and then decreased significantly 
from Day II to Day III. That is, the classes taught on the first two 
days tended to score highest, and the classes taught on the third day 
tended to score lowest. The absence of a significant teacher effect and 
Teacher X Day interaction indicates that, within days, teacher effective- 
ness as measured by the Recall Test was similar across teachers. 

The essay test yielded two scores: number of Concrete themes 
(i.e., number of facts mentioned) and number of Abstract themes (i.e., 
number of principles, extrapolations from facts, etc., mentioned). A 
two-way analysis of variance (Teacher X Day) indicated that these scores 

18 ' ' 
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were stable across teacher and day. That Is, neither amount of teacher 
practice nor the effects of particular teachers were reflected by these 
variables. 

The attitude measure also had two scales. Scores on Attitude Toward 
the Situation (i.e., toward the teacher, subject matter, and learning 
environment) showed a mean increase from Day I to Day II and a decrease 
from Day II to Day III. That is^ the classes taught on the teachers' 
second day of teaching expressed more positive attitudes toward the 
teaching situation than did the classes taught on the first and third 
days of teaching. Within a given day, class mean secures on this 
variable differed significantly from one another, indicating a signifi- 
cant teacher effect. This is especially noticeable on Day III, where 
mean scores for different teachers range from 37.75 ,to 63.62. For this 
variable, the Teacher X Day interaction was also significant. That is, 
the unique combination of a particular teacher and a particular day was 
associated with a particular Attitude Toward the Situation. 

Mean scores on Attitude Toward Self as learner (e.g., satisfaction 
with the student's own participation) did not change significantly across 
days. A significant teacher effect for this variable; however. Indicated 
that over all days class means were significantly different from one 
another. 

In all of these trends, there were some individual differences among 
teachers. The scores of some^ increased with practice on some variables, 
suggesting positive "learning to teach.** Others showed negative "learning 
to teach." Figures 8 through 12 display class means for each teacher for 
each day on each student posttest variable. 

J 3 
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For adjusted Recall Test mean scores (Figure 8) , two patterns pre- 
dominated. Four teachers (Teachers 1, 2, 4, and 8) were relatively 
ineffective on Day 1, but then were among the most effective on Day II. 
On Day III, these four teachers declined in effectiveness, but not to the 
low level of Day I (with the exception of Teacher 4) . The remaining eight 
teachers tended to decline progressively from Day I to Day III. Only one 
of the 12 teachers (Teacher 3) improved in effectiveness from Day II to 
Day III, and this was only a very slight improvement. 

For Essay Test Concrete, tl^e picture is more complex (Figure 9). 
Four teachers' (Teachers 2, 3, 4, and 8) class scores decreased on Day II 
and then increased on Day III. Teachers 1, 7, and 11 exhibited the oppo- 
site patterns. Increasing on Day II and dropping on Day III. The mean 
claes scores increased systematically with practice for two teachers (6 
and 10) , and decreased systematically with practice for three teachers 
(5, 9, and 12). 

The patterns for Essay Test Abstract (Figure 10) are similar to those 
for Essay Test Concrete. Four teachers (Teachers 2, 3, 9, and 12) 
increased in class scores on Day II and decreased on Day III. None of ) 
these teachers had exhibited this pattern for Essay Test Concrete. Three 
teachers' effectiveness decreased on Day II and increased on Day III 
(Teachers 4, 5, and 11). Only Teacher 4 had previously exhibited this 
pattern on the Essay Test Concrete variable. Teachers 1, 7, and 8 sys- 
tematically increased in effectiveness with practice, and Teachers 6 and 
10 changed very little with practice. 
\ The dominant pattern for students' scores on Attitude Toward the 

Situation (Figure 11) shows an increase on Day II and a decrease on Day 

ERLC 20 
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III (Teachers 1, 2, 7, and 8). The opposite pattern, decreasing on Day 
II and increasing on Day III was manifested by Teachers 3, 5, and 12. 
Generally decreasing trends were shown by Teachers 6, 9, and 11, with 
Teachers 9 and 11 decreasing precipitously on Day III and Teacher 6 
decreasing more sharply on Day II than on Day III. 

Attitude Toward Self mean scores (Figure 12) produced patterns 
similar to Attitude Toward the Situation. Again, the dominant pattern 
(Teachers 2, 7, 10, and 11) involved an increase on Day II and a decrease 
on Day III. Only Teacher 6 showed the opposite pattern, decreasing on 
Day II and increasing again on Day III. Four teachers (Teachers 1, 4, 
9, and- 12) showed a generally decreasing pattern with practice; and three 
(Teachers 3, 5, and 8) showed increased scores with practiue. 



2i 
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Fig. 9. 



Mean cipss scores on Essay Test Concrete for Days I to III. 
(Numbers identify individual teachers.) 
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Day I Day II Day III 

Fig. 11. Mean class scores on Attitude Toward the Situation tests for 
Days I to III. (Numbers identify individual teachers.) 
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Discussion a nd Conclusions 

Why did relatively few teachers show marked increases in student 
learning with practice? We expected that as teachers' familiarity with 
the content to be taught, the teaching situation, and the reactions of 
students increased, their effectiveness would increase. Certainly the 
teachers did become more familiar with the content, teaching situation, 
and student reactions; But that was apparently not sufficient for 
improving teaching effectiveness. 

One of the most striking effects in these results is the decrease 
(in the third study) from Day 11 to Day III of student adjusted Recall 
Test scores (11 of 12 teachers) and student Attitude Toward the Situation 
scores (8 of 12 teachers). A comparison of the teaching process varia- 
bles for Days II and III indicated that, for the categories of teacher 
and student verbal behavior measured by an interaction analysis system 
(not described here), teaching on Day II was very similar to teaching on 
Day III. The drop in Day III student posttest scores was probably due 
to qualitative differences in teacher-student interaction not measured 
by the interaction analysis system. Possibly the teachers were bored 
with the task and the curriculum and communicated their lack of enthusiasm 
to the students. Teacher preparation and planning may also have been more 
perfunctory on Day III, leading to poorly organized teaching. 

Another explanation for the results of these studies is related to \ 
the extent to which the Harlow learning-to-learn paradigm of the psycho- 
logical laboratory can be effectively translated into designs for research 
.on teaching. Learning-to-teach, as investigated in the research reported 
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here, may be very different from the learning-to-leam phenomenon inves- 
tigated by Harlow. Harlow used discriminationy£asks of a relatively low 
order in his investigations of learning in rhesus monkeys and children. 
In the present studies, the teachers were faced with a much more complex 
task, namely, combining teaching' skills within a particular strategy in 
such a way as to teach a particular learner or learners most effectively. 
Teaching does involve a number of discrimination tasks : for example, 
discrimination of important learner characteristics, of important facts, 
principles, and concepts imbedded in the subject matter, and of teaching 
skills and strategies likely to be useful in teaching the content. But 
teaching is more than the sum of a series of discrimination tasks. 
Teaching is more akin to a higher level problem-solving task, in which 
the teacher must make a series of decisions about how to behave, given a 
great deal of complex information about subject matter, students, and 
the learning situation. 

A second difference between Harlow's work and ours has to do with 
feedback. In Harlow's studies, the subjects were given immediate feed- 
back after each very brief trial. In the leartiing-to-teach experiments, 
the teachers were not given any information about student achievement. 
We thought that the teachers would be receiving sufficient feedback 
from the interaction with their students to make judgments about the 
effectiveness of their teaching behavior. Further, we assumed that the 
teachers would be able to use the feedback from their interaction .with 
the students to change their teaching behavior in ways that would improve 
their subsequent effectiveness. It is not clear from the data where 
this logic broke down in practice. It may be that explicit and accurate 



feedback about student achievement and attitudes would have helped the 
teachers to improve their effectiveness. On the other hand, teachers 
might not know how to use even explicit and accurate feedback in ways 
that would improve their performance^ Thus, we do not know whether the 
absence of learning to teach in our results was due to inadequate feed- 
back to the teachers or to the teachers' inability to capitalize on the 
information available to them. 

A third area of contrast between the present studies and Harlow's 
learning-to-learn experiments is in the extent to which successive trials 
for any given subject are compa^-able. In Harlow's work, each subject was 
interacting with a mechanism that operated on a fixed and predeteririned 
set of rules. In the learning-to-teach experiments, the curriculum, 
learning objectives, and size of group were held constant in each trial. 
But in our expariments the teacher was interacting with different students 
in each trial — students who were not behaving in controlled or predetermined 
ways* It may be that experience with a particular student or group of 
students is not very useful in improving the effectiveness of interaction 
with a subsequent student or group of students. In other words, familiar- 
ity with the content to be taught, the teaching situation, etc., may con- 
tribute only a small part to the effectiveness with which a teacher inter- 
acts with a new group of students in a similar situation. This question 
could be investigated experimentally by having teachers teach the same 
students over a number of comparable curriculum units. 

Our studies and Harlow's both used highly controlled laboratory 
settings. Important variables such as time, materials, and environmental 
factors were controlled in both sets of studies. Such highly structured 
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situations as we created in our experiments severely restricted the 
freedom of aCrtion of our teachers. Limited time and materials and 
prescribed objectives probably limited their freedom to experiment with 
different teaching approaches, thereby limiting their opportunity to 
learn to teach. Thus, the demand characteristics of the learning-to- 
teach experiments may, ironically, have prevented the phenomenon from 
occurring, 

Finally, the learning-to-teach studies involved only a few trials 
(three or four) for each teacher, whereas Harlow's st;udies employed 
hundreds of trials for each subject. It may be that the hypothesized 
effects of teacher practice as measured by* student achievement do not 
appear until after much more practice than our experimental desigua 
allowed for. Or, it may be that student achievement as we measured it 
is not the "place" to look for the effects of teacher practice. 

In the face of evidence to the contrary^ it is still possible to 
retain some optimicm that situation-specific practice can indeed help a 
teacher become more effective. The studies reported here represent early 

attempts at exploring and demonstrating the leaming-to-teach phenomenon. 

i 

We hAve learned at least three lessons from this series of studies: 
(1) our conceptualization of what is learned by teachers as they gain 
experience must be broadened and clarified; (2) our methodology for 
measuring the effects of such teacher learning on students must be im- 
proved; and (3) the usefulness of direct application of this paradigm 
from the psychological laboratory to designs for research on teaching 
must be reexamined. 
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Implications for Teacher Training 

Practice, by itself, did not enable teachers to increase student 
achievement. This finding indicates that teachers might profit from a 
process that would enable them to observe more systematically the 
effects of their teaching on students — i.e., a training program that 
would help teachers become researchers on their own teaching effective- 
ness. Such a program would capitalize on the fact that every day or 
hour of teaching is an opportunity for a teacher to try new combinations 
of teaching skills and strategies, observe the effects, and adjust 
instructional performance to suit the particular students, situation, 
and subject matter being dealt with. Improvements in teaching effective- 
ness will be achieved only after teachers themselves learn to define and 
solve instructional problems in terms of the uniqueness of the complex 
teaching situations they face alone. 
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